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A device and a method for an infrared image analysing autofocus 

Technical field of the invention 

5 The present invention generally relates to the field of infrared optical systems and 
especially to the apparatus and methods required for automatic focusing on viewed 
objects. 

Background of the invention 

10 

When infrared optical systems are taken into consideration, a number of physical 
properties in connection with this kind of infrared technology must be regarded. The 
limited amount of light energy transmitted through the objective constitutes 
additional difficulties to infrared autofocuses in comparison with visible light 
15 autofocuses. In infrared optical systems like the above mentioned, the limiting 

device is the detecting unit and its performance and efficiency characteristics. This 
is one of the reasons explaining that the attempts at constructing automatic infrared 
image analysing focuses have not succeeded in the past. 

20 An article of Frank R. Boddeke et al in the publication Bioimaging, 2, 193-203, 

(1994) discloses an algorithm for autofocusing including usage of a focus function, 
which algorithm constitutes a basis for image analysing autofocuses. Single and 
multiple use of simple filters are described as well as noise reducing methods in 
practice. 

25 

Due to the above mentioned additional difficulties associated with infrared 
autofocusing apparatus, the complexity of prior known systems has increased to an 
unacceptable level when attempts have been made at managing the low energy level 
of infrared light. The major problem related to such infrared systems is the low f- 
30 number. Infrared systems require a low f-number and as a consequence of this 



requirement, the signal-noise-ratio is low and hence a large number of acquired 
images must be analysed in order to obtain sufficient resolution of the viewed 
object. Processing capacity in such objectives is limited due to the additional costs 
associated with higher processing capacity and the cost will finally fall on the end 
consumer. Until today, no successful solutions of this problem have been made. 

Earlier a focus window has been chosen as a central field of the image detecting 
area. This central field is in practice situated perpendicularly to the optical axis. 
Thus, this used to be the traditional method of proceeding and it is still used by most 
of the prior known active autofocusing systems. However, only a minimal fraction 
of the actual area of the detected image is utilised by this method and desirable 
would be to use a larger or at least the most suitable area of the detected image as 
focus window. 

Object of the invention 

An object of the invention is to provide an automatic focusing device for an infrared 
optical apparatus and a method enabling automatic focusing on viewed objects. 

Another object of the invention is to provide an automatic focusing device for an 
infrared optical apparatus taking the heating of the elements of the optical system 
into consideration. 

Yet another object of the invention is to provide an infrared optical apparatus having 
the image continuously well focused during monitoring an arbitrary process. 

Other objects of the invention are to provide methods to analyse the most rewarding 
area of the detected image, to introduce a powerful and efficient search operation 
for use in automatic focusing systems and to disclose a useful operative focus 
function in automatic focusing devices. 
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Summary of the invention 

A solution of the above mentioned problems is hereby introduced according to the 
5 present invention. The invention is an image analysing focusing device for an 
infrared optical apparatus. It comprises controllable optical convergence means r 
preferably a lens arrangement, image detection means onto which the optical 
convergence means is projecting an image of an object, processing means for 
processing signals from the image detecting means to provide control signals to 
10 control the optical convergence means to focus the image of the object onto the 
image detecting means. 

The invention is characterised by search operation means in the processing means 
analysing the image of the image detecting means to find at least one image 
15 window, which is part of the image, for which a focusing is to be done in 

accordance with predetermined conditions. A focusing function means, preferably 
in the processing means, provides a focusing on the at least one image window, 
based on providing as distinct differences between individual detecting positions 
(pixels) within the image window as possible, using an iterative process. 

20 

By means of the invention is it possible to choose an area of the image detection 
means other than a central area to focus on. Such an area subjected to analysis 
would enable a selection of the most interesting and informative parts of the image 
to be accomplished. A deliberate choice in this described way, could make a 
25 procedure of focusing possible on the most rewarding area of the detected image 
area and thus enhance the focusing performance of the apparatus and improve the 
quality of the focused image. 



30 



Brief description of the drawings 
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The present invention will now be discussed in more detail with reference to 
preferred embodiments of the present invention, given only by way of example, and 
illustrated in the accompanying drawings, in which: 

5 Fig 1 depicts an infrared optical device with an automatic focusing according to the 
present invention. 

Fig 2 shows parts of Fig 1 in more detail in a first embodiment with a possibility to 
choose a suitable focus window. 

10 

Fig 3 depicts a second embodiment with the system of Fig 2 supplemented with 
radiometric instrumentation for thermal calibration. 

Fig 4a illustrates a third embodiment, which uses a movement detection device for 
15 choosing a suitable focus window. 

Fig 4b schematically illustrates an embodiment for inspection of electric cables 
using a mobile image analysing focusing device according to the invention. 

20 Fig 4c schematically shows operation of a pan-tilt equipment using a focusing 
device according to the invention. 

Fig 5 shows a diagram of a low pass filtering with the normalised filtering versus 
the spatial frequency. 

25 

Fig 6 depicts a high pass filtering using the same designation of the axes as in Fig 5. 

Fig 7 illustrates band pass filtering according to the above Fig 5 and Fig 6. 

30 Fig 8 shows a technique for constant filtering according to the above mentioned 
three Fig 5 to 7. 
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Fig 9 illustrates in a block diagram the procedure of focusing using both the lower 
spatial frequencies and the higher spatial frequencies. 

5 Fig 10 shows a schematic block diagram describing the estimation of a distance to 
an object, which is focused on. 

Fig 1 1 illustrates in a block diagram the procedure of correlating viewed objects 
with pre-defined objects. 

10 

Fig 12 shows a block diagram of the calculation of a possible lens position range in 
which the focus position must be contained. 

Detailed description and operation of the embodiments 

15 

With reference to Fig 1 an infrared optical apparatus 10 comprises a number of 
constituents. The optics is represented by a focusing optical convergence 
arrangement 20, which is movable as an integral unit or comprises at least one 
movable optical part. The optical convergence arrangement comprises preferably a 

20 lens or a lens system. However, it is also possible to have reflecting components 
instead of lenses, such as a Cassegrain or Schmidt arrangement. The focusing 
optical convergence arrangement 20 as a whole or its movable part or parts is 
movable along the optical axis (z-direction in Fig 1) and viewed objects are 
projected on an image detecting and creating means 30 by means of the optical 

25 convergence arrangement 20. The image detection means 30 could preferably be a 
focal plane array, FPA, as depicted in Fig 1, but other kinds of image detection 
arrangements are also possible. Thus, even though a detector array 30 is illustrated 
as the image creation means in this embodiment, it is possible to use for example a 
scanning detector arrangement instead of a staring detector arrangement as 

30 described. 
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Image signals are created through detector elements in the detector array 30, which 
image signals are delivered from a detector output 32 to an input 42 of a processing 
unit 40, preferably a central processing unit CPU, a microcomputer or 
5 programmable hardware. This unit 40 comprises two essential units, a compiling 
unit 140, which is responsible for controlling the system to make the search 
operation by means of a search operation, and an analysing unit 150, which 
responsibility is image analysis by iterative numerical and/or similar methods and a 
focus measure function, FMF. After the particular area on which focusing is to be 

10 made is found, by utilisation of the features further described below, the search is 
divided into at least two subsequent steps, a coarse but fast focusing step using the 
FMF based on low spatial frequencies in the image, followed by a succeeding 
slower but more accurate precision step by using an FMF based on high spatial 
frequencies in the image. It is to be noted that this search is intended to be made 

15 automatically. A convenient way of making this is to make the coarse focusing step 
using so-called "riiU-climbing", which means that the iteration is to be continued in 
the same direction of iteration as long as the FMF is increasing. Subsequently, 
"curve-fitting" methods are used for the precision focus step, which means 
adaptation of a mathematical function, such as a second degree polynomial, a 

20 Gaussian function or the like, and calculate the maximum of the equation and based 
upon this information derive the corresponding focus position of the movable part or 
parts of the optical system. 

A further elucidation and description of the operation of the units 140 and 150 in 
25 more detail will follow in coming sections. Thus, the signal processing and image 
analysis of the system is carried out within the processing unit 40, and so is the 
control of the system operation. 

Operative commands are distributed from an output 44 of the processing unit 40 to 
30 the input 52 of a moving means 50 for the optical convergence arrangement as a 
whole or its movable part or parts, preferably an electric motor allowing sufficient 
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resolution or another similar low electric power consuming device. The moving 
means 50 is connected to the focusing optical convergence arrangement 20 and 
controls the arrangement 20 in accordance with its received operative commands 
from the processing unit 40. These operative commands are in turn controlled by the 
5 above search operation of a compiling unit 140, which constitutes an operative basis 
for the processing unit 40 to control the apparatus 10. 

Choice of focus window 

10 In a system of the above described kind the procedure of focusing is initialised by 
detenriination of a view area in the image in which the image is to be analysed 
thoroughly. This view area is denoted focus window. The choice of focus window 
can be made in numerous ways and it is based on different operator requirements 
but also on technical limitations. A number of methods will be presented in the 

15 following for choosing a focus window and a plurality of criteria concerning the 
image, which all could be considered for determination of a useful focus window 
within the image creation means 30 to perform the focus analysing procedure on. 
This focus window will normally correspond to an area of the image of the image 
creation means 30, preferably a plurality of detector elements (pixels) in a detector 

20 array. 

By using the focusing feature according to the present invention it is possible to 
deliberately choose a certain focus window other than the most centrally situated. 
The choice is based on parameters related to the quality of the image and to the 
25 automatic focusing performance. Such a motivated choice of focus window is 

advantageous due to enhancement of the image processing and analysis, which can 
also be made faster. Utilisation of the focusing methods described in this application 
nimimises the risk of ambiguous image analysis with several optical settings 
appearing equally focused. These methods also enable a possibility to find sufficient 
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contrast within an image although little contrast appears in the most central part of 
the image creation means 30, i.e. usually the detector array. 

Another useful way of choosing a part of the image, i.e. analyse at least one of the 
elements (pixels) in the detector array, which part for a certain industrial application 
may be the most valuable, is to utilise thermal differences witiiin the image i.e. 
differences between detector elements in the detector array 30. If the optical 
infrared automatic focusing device is coupled to and combined with a radiometric 
sensor instrumentation, for instance 100, 1 10 and 120 further described below, this 
development may be an advantageous and important approach for an optimum 
choice of focus window. 

A choice like the one mentioned above based on thermal properties may be utterly 
useful and several alternative embodiments are feasible, which all of them build on 
the same principle instrumentation. 

It is to be noted that more than one window may be chosen and several 
simultaneous searches for focus windows may be run in parallel, provided the 
processing capacity of the optical system allows for this parallel operative mode. In 
such a case, more than one estimation of optimal position of the optical convergence 
means is calculated simultaneously. The analysing unit 150 is then furnished with 
predetermined estimations to be able to compare the conditions and decide which 
window to choose among the analysed. 

In a first embodiment, shown in Fig 2, the focusing is carried out through image 
analysis of one single pixel (denoted focus window in Fig 2) within the detector 
array 30. The particular pixel to be image analysed and thus focused on is searched 
among all pixels of the detector array 30 and is chosen due to its thermal properties. 
The pixel is distinguished from all other pixels of the detector array because of its 
extreme temperature value. The pixel subjected to focusing may be either the 
coldest or the warmest. Such an approach requires a bi-directional radiometer 
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connection 1 10 in connection with each pixel of the detector array 30 and with an 
input 102 of a radiometric instrumentation 100 from which output 104 image signals 
with radiometric data are delivered to the input 42 of the processing unit 40. 
Compilation, processing and analysis of received data is performed within the 
5 processing unit 40, first with a coarse process using a low pass filtering, and the 
result of this analysis results in that one pixel is chosen, for which a high pass 
filtering or band pass filtering for precision focusing is carried out. This 
embodiment compares temperatures of different pixels relative to each other and 
therefore no radiometric instrumentation for calibration is required. The iteration, as 
10 operative commands to the input 52 of the moving means 50, is then made on the 

basis of providing at least the best adaptation to the focus function described below, 
for providing as distinct differences between the chosen pixel and at least one of its 
neighbouring pixels as possible. 

15 In a second embodiment with reference to Fig 3, the apparatus focuses on a certain 
predetermined temperature value, for instance 37 °C or on temperature values in a 
closely related temperature interval or alternatively it focuses on another 
temperature value which is the nearest to a fix and predetennined temperature value. 
An absolute determination of a temperature value according to this embodiment 

20 requires radiometric calibration of the instrumentation. This is accomplished by 
means of a radiometric calibration device 110, possibly in combination with a 
temperature detenmning device such as a thermometer 120. An output 104 of the 
radiometric instrumentation 100 is connected to an input 1 12 of the radiometric 
calibration device 1 10. Another input 1 14 of this device 1 10 is connected to a 

25 thermometer input 122. Data from the radiometric calibration device 1 10 is sent 
from an output 1 16 to the input 42 of the processing unit 40, which derives a 
particular pixel, or a particular sub-array of pixels, in the image and then operates in 
a similar way as in the first embodiment. 
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Operation according to the second embodiment would be a convenient and efficient 
method for use when detection of humans is desirable, for example during rescue 
actions or for various surveillance purposes. Especially in combination with some 
kind of scanning equipment, large areas could efficiently be searched and surveyed 
5 from above by a niinimum of personnel. 

In an alternative second embodiment, also with reference to Fig 3, the focus window 
is chosen based on predetermined threshold temperature values. These temperature 
values can be manually or automatically inserted parameters of the processing unit 
10 40. One operative example of an application of this alternative embodiment could 
be related to thermal industrial processes. This often results in an image sub-area of 
pixels. The processing unit 40 then makes an iteration in order to derive the position 
of the moving means 50 giving the best adaptation to the focus function within the 
sub-area. 

15 

In some of these thermal industrial processes, it may be of crucial importance that 
certain temperatures are not exceeded and in other thermal processes, the 
temperature must not pass a lowest value. Nevertheless, when these limitations are 
exceeded anyway, a focus window preferably may be chosen at the position of the 
20 viewed image where this undesired temperature may occur. Then, a clear and 

focused image may be produced and thereafter be checked by controlling staff, who 
take the necessary actions. 

Another alternative second embodiment allows that the processing unit 40, besides 
25 its focusing function, also can make a comparison of certain initial process images 
with current process images to monitor whether temperature differences exceed 
predetermined values or not. If such differences are exceeded, an alarm signal may 
be sent off to controlling staff, who can take the necessary actions to manage the 
arising situation. 
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A third embodiment according to the invention shown in Fig 4a could be an 
operative mode for real time recognition of moving objects within the viewed image 
and a corresponding focusing procedure on the at least one detector element, 
preferably adjacent pixels of the detector array 30 where movement is detected. The 
third embodiment therefore requires addition of a movement detection device 130 
with an input 132 and an output 134 coupled to the detector means 30 and the 
processing unit 40 respectively. The processing unit 40 derives a particular pixel on 
the moving part of the picture on the image and follows this pixel from image to 
image and makes an iteration towards the best focus, by comparing the values of at 
least one pixel in the neighbourhood of the chosen moving pixel and the value of the 
chosen pixel, until the best adaptation to the focus function has been obtained. This 
embodiment could be a convenient and efficient approach to an apparatus for use in 
numerous surveillance applications but also for many other purposes, which are 
more or less closely related to such surveillance applications. 

Other embodiments are illustrated in Fig 4b and 4c, whereby Fig 4b depicts a 
system for inspection of electric cables, which system is movably installed in a 
helicopter. It shall be noted, that the movement of the camera may be controlled 
relative to the position of the vehicle for enhanced operation and focusing 
performance. Fig 4c shows a so-called pan-tilt equipment, preferably in 
combination with a semi-automatic or fully automatic zooming device, which pan- 
tilt equipment will be further described in the following. 

Focus function 

Referring to Fig 1, when the image signals with or without radiometric data are 
delivered from the output 32 of the detector array 30 to the processing unit 40, the 
processing and analysis is initialised in the compiling unit 140 by arranging and 
compiling the image signals by means of a focus function. Such a focus function 
may be chosen in a plurality of ways due to numerous criteria, of which a number of 
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alternative choices are described below. In the closest prior art document, to which 
document is referred above in the background section of the invention, is described 
a number of properties of a useful focus function. The shape of the focus function is 
determined by the focus criterion, some of which are according to the referred 
document: 

• unimodality, unambiguous interpretation of one maximum value of the focus 
function, although other local extreme values may be present; 

• accuracy, clear and unmistakable peak shape of the extreme value; 

• reproducibility; 

• range, even an optical system far away from focus must provide focus 
information; 

• implementation, fast iterative calculation to enable focusing as quickly as 
possible with minimal processing capacity; 

• generality concerning various types of images as well as compatibility with 
existing electronic equipment 

Except for these referred criteria of the focus function, others could be 
independence of other parameters and as well as of outer conditions other than the 
objective distance. 

The following focus function could be used by the here invented focusing device 
and focusing method: 

FMF{z) = jjZ{K®I : -4 (1) 

where the focus measure function FMF(z) is the in z-direction dependent focus 
function and K denotes a variable operator, which is further described below, m is 
another variable and N a factor of normalisation. Each of these three functions (K, 
m, N) can be varied in order to find the optimum focus function. 
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By utilisation of for instance the above disclosed equation (1), where the operator K 
is represented by K=[l 1 1], see Fig 5. A convolution with K yields a low pass 
filtering of the image signal adapted for the coarse focusing. Hereby, high spatial 
frequencies are suppressed, which sometimes is designated filtered out, as the low 
spatial frequencies pass unchanged without any noticeable suppression. This is a 
more rough image analysis than the high pass filtering technique described below. 
This low pass filtering technique is used mainly for the initial and coarse adjustment 
of the optics when focusing. 

Provided utilisation of the same disclosed equation (1), with the operator K where K 
is represented by K=[l -1], see Fig 6, a convolution corresponds with a high pass 
filtering of the image.. As a result of this process, we end up in the reverse relation 
between higher and lower frequencies in comparison with the low pass filtering 
procedure in the above described part. 

A third way of filtering is a band pass category of filtering, which is obtained when 
using the operator K=[l 0 -1], see Fig 7. In this case, high and low signal 
frequencies are suppressed, while middle range frequencies are not. Simply, a 
frequency band is allowed to pass the filter. Yet another way is to use the operator 
K=[l], see Fig 8, whereby the image remains unchanged since all frequencies may 
pass unchanged, which filtering technique in the following will be called all-pass 
filtering. 

When a plurality of operators of said focus function are used at different stages in 
the focusing procedure, it is possible to tailor the filtering process in a way that 
speeds up the focusing procedure substantially and suits the current infrared optical 
system optimally. The focusing procedure is made faster because of the above 
disclosed and convenient method of simultaneously analysing both the low pass 
filtering results and the high pass filtering results, whereby the coarse focusing of 
the low pass filtering may precede the subsequent fine adjustments of the optics, 
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whereby the fine adjustments benefit by utilisation of the results of the low pass 
filtering when the high pass filtering and fine adjustments are carried out. 

An additional an considerable difficulty regarding infrared optical systems is the 
reduced depth of focus (f-number) in comparison with for instance visible light and 
(UV/VIS) optical systems, which forces the objective to comprise a much higher 
resolution in positioning in order to obtain acceptable sharpness. Consequently, an 
automatic focus for an infrared optical system requires a more complex and 
comprehensive focusing procedure where a simplification and improvement of the 
procedure is a prerequisite for development of an operating infrared optical system 
with an apparatus and method of an automatic focus. 

The energy content of photons in the infrared frequency range is lower than of 
photons in the visible frequency range. For this reason, infrared detectors and 
especially uncooled infrared detectors are insensitive in comparison with visible 
light detectors. To compensate for this, most infrared systems are designed with a 
small f-number, which means with a large aperture and large angles down to the 
detector allowing passage of marginal rays and hence an enhanced collection of 
light energy. This yields a small depth of focus in the system and a fast optical 
suppression of higher spatial frequencies. In other words, a so-called magnitude 
transfer function, MTF, falls faster for higher frequencies than for lower frequencies 
when the optical system is defocused. 

By using the focus measure function, FMF based on high spatial frequency content 
of the image, the FMF yields a sharp peak in focus, but very little information when 
the iterative procedure is distant from focus. Inversely, by using the FMF based on 
low spatial frequencies of the image, it gets broader with an analysable derivative 
also distant from focus. Its peak is substantially blunt with a very small or even 
negligible derivative in focus. 
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With reference to Fig 9, a utilisation of FMF based on both the lower and higher 
spatial frequencies, or a combination of these, makes it is possible to take advantage 
of information originating in both frequency ranges, and hence to reach optimal 
performance and an operative search operation. The flow chart visualises the 
operation beginning with the coarse focusing technique using "hill-climbing" (step 
100). This continues as long as the FMF is increasing (step 101). Then the precision 
focusing technique takes over (102) until correct fitting is achieved (step 103) 
followed by a test of the focusing result (step 104). Predetennined conditions 
regarding this check may be whether focusing is within allowed focusing range, 
object subjected to focusing correlates with pre-defined object to focus on etc. This 
focus procedure continues until the focusing result is satisfactory (step 105). 

Search operation for focus 

The analysis of the image continues in the analysing unit 150 of the processing unit 
40. The focus measure function is generated and is objected to analysis. In order to 
determine how this analysis is to be done and what steps it should comprise, a 
determination of the optimum position of focusing optical convergence arrangement 
20 is required. However, finding this optimum position is not the only demand upon 
the search operation. Requirements of the search operation for automatic focusing in 
optical systems in general are numerous and especially in infrared optical systems, 
since these systems involve additional requirements, for instance temperature 
dependent indices of refraction. The search operation has to be accurate and fast, 
reliable and has to require a rrmiimum of processing capacity. Clearly, a search 
operation must of course be a balance of requirements against each other. A few 
crucial properties of the search operation will be mentioned, which are of great 
importance for the usefulness in an automatic focusing: 

• few measuring points, which is equal to few images needed for focusing; 

• only few crossings of the extreme value, i.e. focus position: 
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• recognition of changes in position of the focused object is desirable. 

The search operation described in this work includes a number of steps in 
connection with the focusing, whereby the focusing optical convergence 
arrangement 20 moves in correspondence with the image analysis, which focusing 
steps comprise: 

• fitting of the focus function to another function in good agreement with the focus 
function, preferably by a second degree polynomial or a Gauss polynomial; 

• iterative search for the focus point, i.e. an extreme value with a first derivative of 
zero value, suitably by means of a so called hill climbing technique; 

• tranquil operative commands distributed to the moving means 50 from the 
analysing unit 150 of the processing unit 40 when a focusing or a nearby focus 
position is reached in order to rninimise disturbances. 

An important feature of the search operation is that it is able to combine all three of 
the above mentioned functions. It chooses the function, which for the moment and 
for the current provided circumstances is the most rewarding and the search 
operation has the option to combine all functions freely. Depending on processing 
capacity of the optical system, the search operation may run and use several of the 
functions in parallel. 

In infrared optical systems silicon or/and germanium often are the materials chosen 
for lenses, due to their transparencies to infrared wavelengths. Refractive indices of 
these materials give rise to substantial temperature dependent drifts, which drifts 
influence the focusing accuracy and the infrared optical system in general 
considerably. These drifts can be such extensive that only a fraction of all 
theoretically possible lens positions are relevant to analysis at a given temperature 
value. In other words, focus is undoubtedly achieved in a certain range of the whole 
range of all possible positions of the focusing optical convergence arrangement 20 
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when the arrangement 20 has a certain temperature. The analysis of the focus 
function and the search for the focus position may be done only within this range 
without any risk of finding focus outside of this range. In an optimum situation with 
a steady low or a steady high temperature, a large fraction of the complete set of 
images to be analysed may be omitted, whereby the analysis can be further speeded 
up and through this the focusing procedure of the infrared optical system. 

The above described procedure of focusing guarantees an accurate and correct 
focusing as it uses both the advantages of the low spatial frequency range and those 
of the high spatial frequency range. The information contained in the low range 
prevents the focusing to be made in a false position as it enables the system to 
extract information about its position even distant from the point of focus. 
Information extracted from the high frequency range enables fast and accurate 
search for the point of focus when the system has reached a position nearby the pint 
of focus. 

A system of the above described kind may also be used for estimation of a distance 
to the object, on which focusing is performed, provided a number of degrees of 
freedom are known to the system, i.e. the position of the moving part or parts at 
focus and the temperature of the optics during the focusing procedure. With 
reference to Fig 10, a search operation is written into the compiling unit 140 (see 
Fig 1) for perfoirning the above mentioned estimation and presentation of estimated 
result. It begins with a test of the focusing result (step 110) preferably using the 
same predetermined conditions as in Fig 9. Assuming the focusing result is 
satisfactory (step 111), information on position of the moving part or parts at focus 
and temperature data is delivered (step 112) allowing for an estimation of distance 
to viewed object as well as an estimation of the inaccuracy in this figure (step 1 13). 
This estimation could for example be in the form of a look up table written into the 
compiling unit 140 or the like. Subsequent to this estimation, the result may be 
displayed in any form (step 1 14) to the user of the image analysing optical 
apparatus. 
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Determination of the relation between parameters such as distance from the 
apparatus 10 to a viewed object, temperature of the optical components including 
lenses and focus position of the optics enables a semi-automatic or fully automatic 
calibration. If an automatic focusing procedure supports this calibration, it is also 
possible to determine the temperature and/or position of the focusing optics. This 
information can be displayed to the user in a way similar to the estimation of the 
distance to a viewed object as described above. Also the temperature of the object, 
which is viewed and focused on is possible to determine, based on utilisation of the 
information provided by the radiometric calibration device 1 10. 

According to another embodiment shown in the flow chart of Fig 1 1, geometrical 
objects within the image may be pre-defined and focused on. First in the sequence is 
a definition of a geometrical object to focus on (step 120) and then a check whether 
this object already is contained within the focusing function means 150 (step 121) 
or the object is imported (step 122), preferably from the memory location 160 of the 
processing unit 40. Then the sequence begins to correlate the pre-defined object 
with object within the image (step 123) until correlation is achieved (step 124). 
With correlation, the system may be instructed to focus on the correlating object of 
the image (125). 

Yet another embodiment of the functionality of the search operation means with 
reference to Fig 12 enables a faster and more processing capacity saving operation 
of the image analysing automatic focusing device. The embodiment enables a 
reduced number of images to analyse in dependence on the temperature at which a 
focusing is done. Initially (step 130) is determined the temperature of the moving 
part or parts of the optics as well as the indices of refraction in the optical system. 
When this data is acquired (step 131) a possible range containing the focus position 
is calculated by the processing unit 40 (step 132). As long as an image is within this 
focus range (step 134) it is analysed (step 135) and if the image originates outside 
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the current range, a new image is imported (step 133) for analysis, without 
analysing the previous image. 



A system of the above described kind may also be combined with so-called pan-tilt 
5 equipment. A pin-tilt equipment has a number of pre-defined areas of the image 
detecting means 30, and it changes its position between these pre-defined areas, 
preferably with a polling communication between a control unit. Regarding this 
application, the control unit may be the processing unit 40. During the scanning of 
said pre-defined areas, trigger functions of any kind, for instance moving objects, a 
10 relative or an absolute temperature value or change, may cause the control unit to 

send an alarm signal to an operative unit, such as maintenance staff or action can be 
taken automatically. 

Feasible applications 

15 

An image analysing focusing device according to the invention may be utilised in 
numerous applications. In this section will be described a number of feasible and 
suitable technical fields and areas for the automatically focusing device. One area of 
use is various inspection purposes, especially inspection of electrically operating 

20 devices and inspection of damages related to an increased temperature in a conduit 
or a conductor. An increased temperature of the described kind arises as a 
consequence of enlarged electrical resistance, due to a narrowing in a damaged wire 
or cable. Another related field is power plant inspection. The inspection can be done 
from a variety of hand-held or mobile units mounted in vehicles, helicopters, etc 

25 (see for example Fig 4b). 

A list of inspection applications in connection with the invention according to this 
application follows: petrochemical, furnace, medical, for instance when examining 
tumours, thrombosis, physical CNS injuries and mammary cancer. 
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Another suitable field of use is various surveillance applications. Some of them are 
process monitoring, automation in general and for use research and developing 
activities, especially in the electronics industry and components manufactiiring. 
Others are human or maritime surveillance, aircraft airport surveillance, customs 
5 and security surveillance of for example border-lines. Military and paramilitary is 
yet another conceivable field of use. 

A large number of technical fields will come in consideration when the invention 
according to this application allows for fewer lenses and less complicated 
10 mechanical machinery which in infrared devices is rather expensive, in favour of a 
further developed and by means of processing capacity modernised equipment with 
a considerably reduced total cost for the customers. 
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Claims 

1. An image analysing focusing device for an infrared optical apparatus (10) 
comprising controllable optical convergence means (20), image detection means 
(30) onto which the optical convergence means (20) is projecting an image of an 
object, processing means (40) for processing signals from the image detection 
means (30) to provide control signals to control the optical convergence means 
(20) to focus the image of the object onto the image detection means (30), 
characterised by 

search operation means (140) in the processing means (40) analysing the image 
on the image detection means (30) to find at least one image window in the image 
for which a focusing is to be done in accordance with predetermined conditions; 
and 

a focusing function means (150) in the processing means (40) providing a 
focusing on the at least one image window based on providing as distinct 
differences between individual detecting positions (pixels) within the image 
window as possible using an iterative process. 

2. Device as claimed in claim 1, characterised in that the focusing function means, 
(150) divides the focusing in coarse focusing using a focus measure function, 
FMF based on low spatial frequencies in the image and fine focusing using an 
FMF based on high spatial frequencies in the image. 

3. Device as claimed in claim 2, characterised in that the coarse focusing is done 
by analysing the FMF with a "hill-climbing" technique and the fine focusing is 
done by analysing the FMF with a "curve-fitting" technique. 

4. Device as claimed in any of the claims 1-3, characterised in that the 
predetermined conditions provide options: 

to choose a focus window area of the image detection means (30), other 
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than the most centrally situated area; 

to store acquired focus images digitally in a memory location (160) of 
the processing means (40); and 

to combine the device with various kinds of supporting semi-automatic 
or fully automatic decision-making systems. 

5. Device as claimed in any of the claims 1-3, characterised in that the 
predetennined conditions for finding the image window comprise a coupling of 
the device to a sensor instrumentation (100) enabling focusing on objects within 
the imaged view area depending on their thermal properties. 

6. Device as claimed in claim 5, characterised in that the sensor instrumentation 
(100) is used while monitoring predetermined temperature differences or changes 
within the image window. 

7. Device as claimed in claim 5, characterised in that the predetermined conditions 
comprise providing the sensor instrumentation (100) with a radiometric 
calibration device (110). 

8. Device as claimed in claim 7, characterised in that the sensor mstrumentation 
(100) and the radiometric calibration device (1 10) are used while monitoring 
predetermined temperatures or temperature intervals within the image window. 

9. Device as claimed in any of the claims 1-3, characterised in that the 
predetennined conditions comprise semi-automatic or fully automatic calibration 
of the relation between of at least two of the following parameters: 

distance from the apparatus (10) to a viewed object; 
temperature of the optical convergence means (20); and 
focus position of the optical convergence means (20), 
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which calibration is supported by the automatic focusing. 

10. Device as claimed in any of the claims 1-3, characterised in that the 
predetermined conditions comprise estimation of a distance from the apparatus 
(10) to a viewed object based on information on temperature and/or position of 
the optical convergence means (20). 

1 1. Device as claimed in claim 10, characterised in that the predetermined 
conditions comprise estimation of a distance from the apparatus (10) to a viewed 
object based on information on temperature and/or position of the optical 
convergence means (20) comprising at least one of the options: 

presenting estimated distance to the viewed object; 
presenting inaccuracy of the estimation; 
presenting a combination of the above estimated distance and 
inaccuracy; 

presenting data only when the search operation means (140) has 
obtained an acceptable focus position. 

12. Device as claimed in claim 10, characterised in that an estimation of the 
temperature of a viewed object is done based on information on an estimation of 
distance from the apparatus (10) to a viewed object provided by the calibration 
device (1 10), optics temperature and/or position of the optical convergence 
means (20). 

13. Device as claimed in claim 12, characterised in that an estimation of the 
temperature of a viewed object is done based on information on a distance from 
the apparatus (10) to a viewed object, optics temperature focus position of the 
optical convergence means (20) comprising at least one of the options: 

presenting estimated temperature of the viewed object; 
presenting inaccuracy of the estimation; 
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presenting a combination of the above estimated temperature and 
inaccuracy; 

presenting data only when the search operation means (140) has 
obtained an acceptable focus position. 

14.Device as claimed in any of the claims 1-3, characterised in that the 

predetermined conditions for finding the image window comprise coupling to a 
movement detection device (130) which coupling enables focusing on moving 
objects, by means of the focusing function means (150), whereby the focus 
window is movable across the image and follows the moving object in the 
window during the focusing. 



15. Device as claimed in any of the claims 1-3, characterised in that the 
predetermined conditions for finding the image window comprise correlation of a 
geometrical object in the image with a pre-defined geometrical object in the 
focusing function means (150) prior to focusing on the particular geometrical 
object of the viewed image. 

16. Device as claimed in claim 15, characterised in that the focusing function 
means (150) for correlation comprises the geometrical objects as 2-dimensional 
electronic images supplied via for instance a PC-card or another information 
transmitting means. 

17. Device as claimed in any of the claims 1-3, characterised in that the 
predetermined conditions comprise a calculation by the focusing function means 
(150) of possible ranges for the focus position at a certain temperature, whereby 
image analysis in impossible intervals can be omitted and processing capacity 
reduced. 
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18. Device as claimed in any of the claims 1-3, characterised in that the 
predetermined conditions comprise control by the focusing function means (150) 
to adjust the focus position to infinity when no object to focus on can be found 
within the viewed image. 

5 

19. Device as claimed in any of the claims 1-3, characterised in that the device is 
used in a pan-tilt type of equipment where the processing unit (40) controls a 
repeated sequence of movements between pre-defined objects or focus windows 
within the viewed image and may send notification messages in response to 

10 predetermined trigger conditions. 

20. Device as claimed in claim 19, characterised in that the pan-tilt equipment in 
the processing unit (40) includes a register (160) of preceding focus data used for 
adjusting the focus position or a nearby focus position already during the moving 

15 from one viewed area to the next area to be viewed, whereby the focusing is 

obtained faster leading to more efficient operation. 

21. Device as claimed in claim 19, characterised in that the predetermined trigger 
conditions comprise for instance thermal conditions and/or object movements 

20 within a pre-defined area. .. 

22. Device as claimed in any of the preceding claims, characterised in that it may 
be used in combination with or be equipped with an integrated semi-automatic or 
fully automatic zooming device. 

25 

23. Device as claimed in any of the preceding claims, characterised in that it may 
be used in combination with or may be equipped with an integrated position 
determining device, such as a global positional system, GPS, whereby the 
processing means (40) may calculate and present positions of viewed objects 
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relative to positional data from the GPS. 



24. An image analysing focusing method for an infrared optical apparatus (10) 
comprising controllable optical convergence means (20), image detecting means 

5 (30) onto which the optical convergence means (20) is projecting an image of an 

object, processing means (40) for processing signals from the image detecting 
means (30) to provide control signals to control the optical convergence means 
(20) to focus the image of the object onto the image detecting means (30), 
characterised by 

10 analysing the image on the image detecting means (30) to find at least one image 

window in the image for which a focusing is to de done in accordance with 
predetermined conditions; and 

providing a focusing on the at least one image window based on providing as 
distinct differences between individual detecting positions (pixels) within the 
15 image window as possible using an iterative process. 

25. Method as claimed in claim 24, characterised in that the focusing is divided 
into a coarse focusing step using FMF based on low spatial frequencies in the 
image and a fine focusing step using FMF based on high, spatial frequencies in 

20 the image, whereby the two. focusing steps may be combined for an optimum 

result. 

26. Method as claimed in claim 24, characterised in that the coarse focusing is 
done by analysing the FMF with a "hill-climbing" technique and the fine 

25 focusing is done by analysing the FMF with a "curve-fitting" technique. 

27. Method as claimed any of the claims 24-26, characterised in that the 
predetermined conditions of the focusing comprise use of a focus function of the 

form FMF{z) = — Yj( k ® h ~ m ) 2 » where K is an operator, N a factor of 
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normalisation and m is a variable. 

28. Method as claimed in claim 27, characterised in that the operator values of the 
focus function comprise: K=[l 1 1], K=[l -1], K=[l 0 -1] and K=[l]. 

29. Method as claimed in claim 28, characterised in that use of the operator values 
of the focus function is made with a variation depending on individual 
requirements of each system, for instance by applying the operator functions in 
more than one direction in the image. 

SO.Method as claimed in any of the claims 24-29, characterised by its application 
in any of the following technical fields, although also many other technical fields 
are conceivable: 

inspection of electrically operating devices; 

temperature related process inspection, momtoring and surveillance; 

medical, chemical, petrochemical and furnace inspection, some of 
which can be done using hand-held and/or mobile units mounted in vehicles, 
helicopters; 

research and development, especially related to the electronics industry 
and components manufacturing; 

human, civilian and military surveillance. 
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Abstract 

An apparatus and a method is introduced by which infrared image analysing 
automatic focusing is made possible. The invention among others comprises a focus 
function to be used by a search operation in order to control a moving means (50) 
adjusting a focusing optical convergence arrangement (20). Usage of the invention 
enables a fast and efficient way of obtaining a focused image although the infrared 
optical system is a difficult system and a not particularly rewarding technique in the 
past. 
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